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ABSTRACT 


In the optimal linear quadratic regulator problem for finite dimensional 
systems, the method known as an cx— shift can be used to produce a closed— loop system 
whose spectrum lies to the left of some specified vertical line; that is, a closed- 
loop system with a prescribed degree of stability. This paper treats the extension 
of the a-shift to hereditary systems. As in finite dimensions, the shift can be 
accomplished by adding a times the identity to the open-loop semigroup generator and 
then solving an optimal regulator problem. However, this approach does not work 
with a new approximation scheme for hereditary control problems recently developed 
by Kappel and Salamon. Since this scheme is among the best to date for the 
numerical solution of the linear regulator problem for hereditary systems, an 
alternative method for shifting the closed-loop spectrum is needed. An a-shift 
technique that can be used with the Kappel-Salamon approximation scheme is 
developed. Both the continuous-time and discrete-time problems are considered. A 
numerical example which demonstrates the feasibility of the method is included. 


v 'This research was supported in part by The Air Force Office of Scientific 
Research under contract No. AFOSR-84-0309. 

(**^This research was supported in part by the The Air Force Office of Scientific 
Research under contract No. AFOSR-84-0393. 

(^Part of this research was carried out while the authors were visiting scientists 
at the Institute for Computer Applications in Science and Engineering (ICASE), NASA 

Langley Research Center, Hampton, VA, which is operated under NASA contracts 
No. NAS1-17070 and No. NAS1-18107. 

A !%(d' S>5! ^ 


i 



1. INTRODUCTION 


In this paper we consider the problem of computing optimal linear state 
feedback control laws for linear hereditary systems which yield a resulting 
optimal state trajectory that exhibits a prescribed degree of stability. This 
problem is sometimes referred to as the linear quadratic regulator problem 
with a-shift, a being the desired degree of stability, since it involves a 
linear state constraint, the minimization of a quadratic payoff functional and 
the shifting of the closed-loop spectrum to the left of the line Re z = -a in 
the complex z-plane. A solution is a control law of the form 


(1.1) u(t)= — K(x (t), x t ), t > 0 


where K is a linear function of the optimal trajectory x (t) and its past 

history at time t, x = x (u ) is the solution to the underlying hereditary 
* 

system, u minimizes a performance index which is quadratic in the state and 
the control and x satisfies a uniform exponential bound of the form 


( 1 . 2 ) 


|x (t)| < Me^**, t > 0 • 


These ideas will be made precise in the subsequent Section 2. 

In finite dimensions, i*e. when the state is given by a linear ordinary 
differential equation of the form 

(1«3) x(t) = Ax(t) + Bu(t), t > 0, 


the linear quadratic regulator problem with a-shift and its solution are well 
known (see [1], [2]), The matrix A is simply replaced by the matrix 



- 2 - 


A + al and the resulting standard linear quadratic regulator problem (the 
shifted problem) is solved in the usual fashion. 

A hereditary system, on the other hand, is infinite dimensional. In- 
stead of the matrix A being replaced by A + al, it is the infinitesimal 
generator A of the solution semigroup which is replaced by A + al. The 
solution of the resulting shifted regulator problem requires the use of some 
form of finite dimensional approximation. One is tempted to take the general 
approach which by now has become standard in the control of infinite 
dimensional or distributed systems. That is, approximate the unshifted system 
using one of the currently available schemes for the regulator problem for 
hereditary systems and then apply the standard finite dimensional theory and 
techniques to the finite dimensional approximating systems to obtain 
approximations to the shifted system. However, as we discovered, this 
approach may not work. 

The linear spline-based approximation scheme for the linear quadratic 
regulator problem for hereditary systems recently developed by Kappel and 
Salamon in [14] has been shown to be, in many respects, one of the most 
attractive approximation methods currently available for this class of 
problems. However, the finite dimensional approximating systems possess 
eigenvalues which do not converge to eigenvalues of the original underlying 
hereditary system. Those eigenvalues are stable and hence do not cause 
difficulties when the unshifted problems are solved. However, they are 
extremely difficult, if not impossible to shift. Consequently, even if the 
poles of the hereditary system which are to the right of the line Re z = -a in 
the complex z-plane can be shifted (i.e. the finite dimensional subspace 
spanned by the eigenvectors corresponding to the eigenvalues with real part 
greater than or equal to -a is controllable), when the a-shift is 
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applied to the approximating systems the solution of the resulting finite 
dimensional regulator problems fail. 

We have found a relatively simple and straight forward way to overcome 
this difficulty. It involves a modification of the infinite dimensional 
shifted system which permits the extraneous eigenvalues introduced by the 
approximation to remain stable while the true eigenvalues of the hereditary 
system are forced to the left of the line Re z - -a. 

In the paper we have treated both the continuous-time and the discrete- 
time or sampled problems. The Kappel-Salamon approximation and the a-shift 
are discussed in Section 3. In Section 4 we provide an example with numerical 
results. 
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2. THE OPTIMAL LINEAR QUADRATIC REGULATOR PROBLEM FOR HEREDITARY SYSTEMS WITH 

A PRESCRIBED DEGREE OF STABILITY 


We consider linear hereditary control systems of the form 


( 2 . 1 ) 


x(t) = Lx t + B Q u(t), t > 0, 


( 2 . 2 ) 


x(0) = n, x Q = <J) , 


where x(t) e R , u e L 2 (0,t f ;R ) for each t f with 0 < t < » , 

®0 e ^ ( R ,R ), n e R , <(> e L 2 (-r,0;R n ) and for each t > 0, 

x t e L 2^ -r,0;R ^ denotes the past history of the state x on the interval 

That is, x t (0) = x(t-tf)), -r < 0 < 0. The linear transformation L 
is assumed to be of the form 


(2.3) U|i = l Ai(-r.) + J° A(0)ij»(0)d0 
1=0 1 r 


with A ± e l(R n ,R n ), i = 0,1,2,.. . ,v, (v < «), A e L„(-r,0; i.(R n ,R n )) 


and 


0 " r 0 < r l < r 2 < r v = r - 


Standard arguments yield the existence of a unique solution x( ; n,<(>,u) to 
(2.1), (2.2) which is absolutely continuous with x( ; n,<|>,u) e L 2 (0,t f ;R n ) 
for any t^, 0 < t^ < 00 , which satisfies (2.1) for almost every t > 0 and which 
depends continuously on n ,<j> , and u. 

A one parameter family of solution operators for the homogeneous system 
corresponding to (2.1), (2.2) can be defined by 


(2.4) T( t ) (n ,d> ) = (x(t;n ,<f> ,0), x t (n ,<J> ,0)). 
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If we let Z = R n x L 2 (-r,0;R n ) together with the usual inner product 

(2.5) <(5 ,¥),(? ,x)> z + /° r 'K0) T x(e)de, 

then the family of operators, { T(t) s t > 0} forms a C 0 semigroup of bounded 
linear operators on the Hilbert space Z. The infinitesimal generator is given 
by 


Dom(A) = {(5,t)eZ:fe H^-r.OjR 11 ), ? = «K0)} 

(2.6) A(*(0) f 4O = (Lf,D<|») • 

If we define the operator B: R™ * Z by 

(2.7) Bu = (B q u,0) 

then an equivalence exists between solutions to (2.1), (2.2) and mild or 
generalized solutions to the abstract evolution equation 

(2.8) z(t) =Az(t) + Bu(t), t > 0 
with initial condition 

(2.9) z(0) = (n,$) • 

That is, z(t) = (x(t;n ,<f>u), x (n ,<(> ,u)) , where 
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(2.10) z(t) - T(t)(ri,<(>) + /q T(t-s) Bu(s)ds, t > 0 . 

In the subsequent discussion, when the solution to the system (2.8), (2.9) is 

referred to, it should be understood to imply the mild solution given by 

( 2 . 10 ) . 

2.1 THE CONTINUOUS-TIME PROBLEM 

The control problem which is of interest to us here is the infinite time 
horizon linear quadratic regulator (LQR) problem given by 

* m 

Find u e I^CO, 00 ;!^ ) which minimizes the performance index 
00 

(2.11) J(u) = / x(t) T Q n x(t) + u(t) T Ru(t)dt 

0 U 

where x is the solution to (2.1), (2.2) corresponding to u. 

The matrix Qq e L (R >R ) is assumed to be nonnegative, symmetric and the 
matrix R e L (R m ,R m ) is assumed to be positive definite, symmetric. 

Defining the nonnegative, symmetric operator Q : Z Z by 

(2.12) Q(S,*) = (Q q 5,0), 

we treat the equivalent LQR problem given by 
& 

(PI) Find u £ 1 * 2 ( 0 , 00 ;R ) which minimizes 

00 

J(u) = / <Qz(t),z(t)> + u(t) T Ru(t)dt 
0 Z 


(2.13) 
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where z is the solution to (2.8), (2.9) corresponding to u. 

We summarize the results from [7] concerning the solution of problem 
(PI). An admissible control for the initial state z(0) = (n,<j>) e Z is a 
function u £ l^O," ;R m ) for which J(u) < 00 . Under the assumptions 

(Al) for each initial state, z(0) = (n,<t>) £ Z there exists an admissible 
control, 

and 

(Bl) the operators L, Bq and Qq are such that any admissible control u 
drives the state z(t), t > 0 to zero, asymptotically as t -*■ 00 , 

there exists a unique nonnegative, self-adjoint solution P £ L( Z,Z) to the 
Riccati algebraic equation 

(2.14) A* P + PA- PBR _1 B* P+ Q = 0. 

* m 

The unique solution u £ L 2 (0,«>;R ) to problem (PI) is given in feedback form 
by 

(2.15) u*(t) = — R~ 1 B* Pz*(t), t > 0 


and 


(2.16) j( u *) = < P(n,4>),(n,<j))> z . 

The optimal trajectory, z , is given by 
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(2.17) z*(t) -S( t)(n ,<t> ) 

where (S(t) : t > 0} is the Cg semigroup generated by A- 8R - * 8*P. The 
semigroup (S(t) : t > 0} is uniformly exponentially stable, i.e. there exist 
positive constants M and w for which 


(2.18) |S(t)| < Me' Wt , t > 0 . 

The operator A is given by 


Dom(A*) = {(5,<|0 e Z : e L 2 (-r,0;R n ) ,<|> absolutely 

continuous on [~r,0] except at the points -r^ , . . . ,-r v _j 
where <K(-r i ) + )-<J>((-r i ) ) = A^5, 1 < i < v - 1 
and iK-r) = A^U , 

(2.19) A* (5, <|») = (A + <K0), kh - Dip) 


and is the infinitesimal generator of the Cq semigroup {T (t) : t > 0} 


We have P Z c Dom (A )• 



The operator P can 

be represented 

by a matrix of operators 


o 

o 

poA 

(2.20) 

p = 



VplO 

pn / 


.00 


where P'"' e L(R n ,R n ) is a nonnegative symmetric matrix. 
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P 10 e L 2 ( -r , 0 ; L(R n ,R n )), P 01 = P 10 with 

(2.21) P% = / P 1O (0 ) T '|»(9 )d9 , ^ e L 2 (-r,0;R n ), 

“I* 

and P 1 * e L(L2(-r,0;R n ),L2(-r ,0;R n )) is nonnegative and self-adjoint. We 
have 

(2.22) u (t) = - p°x (t) - / p 1 (6)x t (0)d9 , t > 0 

-r 

. 0 —I T „00 , l /nN —I T „ 10 /on T ^ n ^ ^ 

where p = R Bq P and p (0) = R Bq P (0) , -r < 0 < 0. 

We note that Assumption (Al) is satisfied if the unstable subspace of L 
(which is finite dimensional, see [9], [23]) is controllable. Assumption (Bl) 
is certainly satisfied if Qq is positive definite. 

The Continuous -Time Problem with a-Shift 

An a-shift, we recall, is a technique which is used in conjuction with 

the standard LQR theory to obtain an optimal feedback control which yields not 

just an asymptotically stable closed-loop system, but rather, one which 

exhibits a prescribed degree of stability, that is, one for which the state 

—at 

z(t) decays at least as fast as e , i.e. 

(2.23) | z( t ) | z < M e _ ° tt |z(0)| z 

A 

where M is a positive constant and cx > 0 is the desired degree of stability. 
For the hereditary systems of interest to us here, this is completely 
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equivalent to requiring that the eigenvalues of the closed-loop system have 

real part less than -a. A discussion of this problm and its solution for 

finite dimensional systems first appeared in [1] and can also be found in [2]. 

One approach to solving this problem involves the inclusion of the 

2ct t 

multiplicative factor e under the integral sign in the performance index 
given in (2. 13). However, making the change of variables 


(2.24) 

z(t) = e at z(t) 

(2.25) 

u(t) = e at u(t) 


it is easily seen that if one solves the modified LQR problem 

(PI) Find u e L^(0 ^ ;R m ) which minimizes 
00 

(2.26) J (u) = / <Qz(t),z(t)> + u(t) T Ru(t)dt 

—00 

A 

where z is the (mild) solution to the abstract evolution system 

(2.27) z(t) = ( A+ al)z(t) + 8 u(t), t > 0 

(2.28) z(0) = (n ,<j> ) 
and applies 

(2.29) u a (t) = e" 01 Si (t), t > 0 

to the original control system (2.8), (2.9), the resulting optimal trajectory. 
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z a , will satisfy (2.23). 

Strictly speaking (2.27), (2.28) is not a hereditary system. However, 
the results outlined above concerning the solution of problem (PI) in closed- 
loop form are in fact derived from a more general abstract theory (see [6]). 

A 

This more general theory can be applied directly to problem (PI). Under 
assumptions (Al) and (Bl) (with z, u, and J replaced by 

A A A ^ 

z, u and J respectively) the unique solution to problem (PI) is given in 
state feedback form by 

A ^ i ^ A A jL 

(2.30) u = -R BP z (t), t > 0 

A 

where P e L( Z,Z) is the unique nonnegative self-adjoint solution to the 
Riccati algebraic equation (2 • 14 ) with A and A replaced by A + al and 

_f _ A 

* 

A + al respectively. The operator P can be represented by a matrix of 
operators analogous to the one given in (2.20). From (2.24) and (2.29) we 
obtain 

(2.31) u*(t) = -R~V P z*(t), t>0. 

It then follows that 

(2.32) z*(t) = S a (t)(n,<f>), t>0 

with 

|S a (t)| < M e“ at 


(2.33) 


y 


t > o 
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where (S o (t) : t > 0} is the C 0 semigroup generated by A” 8R~* B* P . 

Since the shifted system (2.27) is not a hereditary system, it would seem 
that to obtain the estimate (2.33) from the general theory presented in [6], 
the coercivity of Q would be required. (In the case of a hereditary system, 
assumption (Bl) is sufficient.) However, as will become clear in the next 
section, (2.27) is in fact related to a hereditary system through a bounded 
similarity transformation. Consequenly, assumption (Bl) is sufficient to 
obtain the uniform exponential bound (2.33) for the shifted system as well. 

The controllability of the finite dimensional generalized eigenspaces 
corresponding to the eigenvalues of A with real part greater than or equal to 
-a is sufficent to conclude that assumption (Al) holds for the shifted system. 


2.2 THE DISCRETE-TIME PROBLEM 

The discrete-time or sampled analog of problem (PI) is given by 


* * 00 


(P2) Find u - {u^} e which minimizes 


_ rji m 

(2.34) J(u) = l <Qz , z > + u Ru where z = (z } satisfies the recurrence 

K K=U 


(2. 35) z k+l = Tz k + Bu k , k- 0,1,2,..., 


with 


(2.36) z Q = (n,<f>). 

The operators T e L(Z,Z) and Be L(R m ;Z) are defined by 
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(2.37) T = T(x ) and B- /J T( s) Bds, 


respectively, where x denotes the length of the sampling interval. 

The characterization of the solution to the discrete-time LQR problem in 
state feedback form for infinite dimensional systems is treated in [18] and 
[24]. The application of the general theory to problems involving hereditary 
systems is discussed in [8]. The results are completely analogous to those 
given above for the continuous-time problem. We briefly summarize them here. 

An admissible control sequence u e J4 ^ (0 ,°° ; R m ) for the initial condition 
Zq = (n,4>) e Z is one for which J(u) < 00 . If the assumptions 

(A2) for each initial condition Zq = (n,<|>) e Z there exists an admissible 
control 

and 


(B2) 


the operators L, Bq and Qq are such that if u is an admissible 

control for the initial condition Zq = (n,<)>) then the state 
00 


z = (z^}j^_q given by (2.35) satisfies lim 

kr*® 


'k 1 Z 


= 0 


hold, then there exists a unique solution to problem (P2) which is given in 
linear state feedback form by 


(2.38) 


* : k 

u k = -Fz k , k = 0,1,2,... 


where 
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(2.39) F = R _1 B*PT, 

(2.40) R = R + B*PB 

and P is the unique nonnegative self-adjoint solution to the Riccati algebraic 
equation 

1 jL 

(2.41) P = T (P - PB(R + B PB) B P)T + Q . 

The minimum value of the performance index can be computed from 

(2.42) J(u ) = <P(n,<J>),(n,<(>)> z 
and the optimal trajectory z satisfies 

(2.43) z* = S k (n ,<(>), k = 0,1,2,... 
where S e L( Z,Z) is given by 

(2.44) S = T-BF . 

We also have the following result. 

Theorem 2.1 If assumptions (A2) and (B2) hold then the operator S has 
spectral radius less than 1 and there exist positive constants M and p with 
P < 1 for which 
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(2.45) |S k | < Mp k , k = 0,1,2,... 

Proof 

Since (T (t) : t > 0} is the solution semigroup for the hereditary system 
(2.8) and the operator BF is of finite rank, the operators = (T - BF)^ are 
compact for all k sufficiently large. It follows therefore (see [5], Chapter 
VII, Section 4, Theorem 6) that the spectrumn of S, o(S), contains at most a 
countable number of points with no accumulation points in the complex plane 
except possibly X = 0. The non-zero elements in o(S) are in the point 
spectrum of S; that is, they are eigenvalues of S. 

Now suppose Aea(S),A*0 and S(£,i|0 = A(£,t|>) with (5,^) * 0. If 
£ * 0, then for Zq = (Si,'!') the optimal trajectory is 

(2.46) z* = S k (5,iJ>) - A k (5,l»), k =0,1,2,.... 

Consequently assumption (B2) implies X < 1. If K = 0 and 
(0,i|0 4 W(F), the null space of F, then z^ = (0,^) implies 

(2.47) u* = -Fz* = -FS k (0,i|<) = -xVo.t), k- 0,1,2,... 

Since u e (2.47) implies X < 1. Finally, if (0,ij>) £ W(F), then 

(2.48) A(0,i|>) = S(0,i|>) = T(0,i|») = (x(x;0,+,0), ^(0,^,0)) 
which implies = 0 and consequently that X 4 tf(S). 
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Therefore, we conclude that the spectral radius of S is less than 1 and 
i ki k 

that | S | < p for all k sufficiently large for some positive p < 1. The 
uniform exponential bound (2.45) immediately follows. 

The operator F e L(Z,R m ) can be represented by a matrix of operators, 
(F^,F^) where F e L(R n ,R m ) can be represented by an mxn matrix f^ and 
pl e ^( L 2^*" r ’ 0;Rn ) ,Rnl ) can be re P resented b y a square integrable irt*n matrix 
valued function f 1 defined on the interval [-r,0]. We have 

(2.49) u* = -f°x*(kr) - /° r f 1 (0)x^.(6)d0, k= 0,1,2,... 

>n> ^ ^ 

with (x (kr), x^) = z k , k = 0,1,2 


The Discrete-Time Problem with a -Shift 

The shifted problem in discrete-time involves the finding of an optimal 

* * 
control u Q for which the resulting optimal trajectory z a satisfies 


(2.50) 



k = 0,1,2,... 


where a, the prescribed degree of stability is a positive number less than 1. The 

A 

modified discrete-time problem (analogous to problem (Pi)) takes the form 
A A ^ 

(P2) Find u e ^(O* 00 ;^ 111 ) which minimizes 


(2.51) J(u) 


A A A rji A /v 

I <Qz.,z.>„ + u.Ru. where z 
j =0 J J L 3 3 




satisfies the recurrence 


z 


k+1 




k = 0,1,2,... 


(2.52) 



(2.53) 


z Q = Cn ,<J> ) . 


Assumptions analogous to (A2) and (B2) yield 


(2.54) 



k = 0,1,2,... 


where F is given by (2.39) - (2.41) with T and B replaced by 
if and ^ B respectively. It follows that 


(2.55) 


u . = -Fz , , k = 0,1,2,... 
a,k a,k * » » > 


with the optimal trajectory given by 


(2.56) 


■k k 

z . = s (n ,<j> ) , 
a ,k a ,Y ' 9 


k » 0, 1 ,2,. • . 


where £ L( Z,Z) is defined by 


(2*57) 


S 


a 


T - BF • 


The operator has spectral radius less than 1 and is uniformly exponentially 
bounded; 


(2*58) 



k = 0,1,2,.. 


where M is a positive constant which does not depend on k. 
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3. APPROXIMATION 

A 

The infinite dimensionality of problems (PI) (or (PI)) and (P2) 

(or (P2)) necessitates the use of some form of finite dimensional 
approximation to solve them. The standard approach involves the use of finite 
element (Rayleigh-Ritz, Galerkin, etc*) techniques to discretize the state 
equations (2*8) (or (2*27)) and (2*35) (or (2*52)). A sequence of finite 
dimensional LQR problems result, each of which can be solved in linear state 
feedback form using standard techniques and readily available software* The 
averaging , or AVE scheme, which uses piecewise constant elements with finite 
differencing, and its application to the continuous time problem is carefully 
studied in [7]* A linear spline based Galerkin method is treated in [4]* 

More recently, methods using piecewise linear elements [21] and Legendre 
polynomials [13] and a method based upon Lanczos* T -method for partial 
differential equations which also uses Legendre polynomials [12] have yielded 
promising results* 

While AVE yields strong L 2 convergence of the approximating feedback 
kernals, the observed rate of convergence is relatively slow. The spline 
based scheme, by some measures, offers superior performance. However, it 
appears that only weak convergence of the approximating feedback kernals 
can be obtained* Kappel and Salamon [14] have developed a new linear spline 
based method which performs at the level of the original spline scheme and 
which seems to yield strong L 2 convergence of the approximating functional 
feedback gains* It is this approximation scheme which is the focus of our 


discussions below, 
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3.1 AN APPROXIMATION SCHEME FOR LINEAR HEREDITARY SYSTEMS 

We briefly outline the details of the formulation of the Kappel-Salamon 
scheme. Fundamental to their approach (and unlike the standard Galerkin 
approach) is the choosing of the approximating spaces so that they are not 

*n» 

subspaces of either Dom(A) or Dom(A )• Herein lies the key to obtaining 
strong L 2 convergence of the approximating feedback kernals. 

For each N = 1,2,... let 

Ar 

(3*1) ~ r k-l — ^ ^ , k = 1,2,. . • ,v , j = 0,1,2,..#,N 

where 


(3.2) Ar k = r fc - r k-1 , k = 1,2,.. .,v 


k i N 

Let denote the usual linear B-spline elements with respect to the 

mesh on the interval [-r k , k = 1,2,.. *N and extended 

to be zero elsewhere on the interval [-r,0]. That is for each k = 1,2,...,N 


+^’ 0 (6) - 


JL (q _ e 1 ^* 1 


Ar, 


(e - 


9 c [S^ 1 , 8*-°) 


elsewhere 


(9 - 0 k ’ J X ), 0 e [0*’ J ,e*’ J l ] 


Ar 


N ’ N 


(3.3) 


«)> k »j( 0 ) = { *L 

v } 1 Ar, 


(0 - e ^’ J+1 ), 0 e [ei ,j+1 ,0i ,J ] 


N 


0 


elsewhere 
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j = 1,2,. .. ,N-1 and 


+J* N ( 0 ) = 


-N 


Ar. 


(0 - 


efc.N-i 

N } * 


6 e [0 n ,N » 6 n’ N 1] 


elsewhere • 


Defining 


(3.4) 


e N = ^n* 0 ^ and 


'N 


= (0, <J> 


N 


V 


in R n n x L 2 (-r,0;R nXn ) where 1^ denotes 


the n*n identity matrix, we let 


N 


(3.5) Z N - e Zs «,+ N ) = a Q + I l 


k=l j=0 


e N ,ja k,j’ V a k,j £ rR} * 


0 k t 

The collection {e N , e N ’ J } is a basis for the K n = n((N+l)v + 1) dimensional 

subspace of Z, and a = (a^, a^ Q,...,a y N ) T is referred to as the 

coordinate vector with respect to the basis {e^, e^’^} for the element 

N N 

(Sj’J'fl) e Z N « Defining 


(3.6) 


N 


( e ° e 1 ’ 0 
' e N* e N » 


e V ’ N ) 
,e N ; 




we have (S,^ N > = E N a. 

Let Z + denote the orthogonal projection of Z onto Z^* It is 

immediately clear that p N (S f ip) = (5,*^) where tt is the orthogonal projection 

of L. 2 (-r, 0 ;R n ) onto spanC^^^I } . 

46 N n 
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Noting that Z^ <£ Dom(A), approximations A N : Z N +• Z N to the operator A are 
defined by first extending A to all of Z N . for (?,^) £ Z N , define 


(3.7) 


Att,1> N ) - (L«,t N ),D(5^ N )) 


where 


v 0 

(3.8) L(5,V =A 0 ?+ ^ A k^N (_r k ) + / A(6)t N ( 0 )d0 

k=l 


-r 


and 


v— 1 

(3.9) D(5,* m ) = D + * + 6 « - limj (0)) + I VV"V “ li® _V e » 

N n u 0^-0 N k=l 6+-r, 

k 

with the Dirac delta impulse centered at -r 4 , i = 0,1,2,.. .v-1 and D the 


derivative from the right of '|> w . 

Let £ i (R , R ) be given by 


(3.10) 

m n <e n ,e n > z 


and define 

k + k 

6 9 6 9 
N ’ N 

e L(R n ,Z N ) 

by 

(3.11) 

S n’ +5 

■ Vh’ +5 ' 

k = 

(3.12) 

6 s’" 5 

- VN k> ' 5 > 

k = 


where 
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(3.13) 


(3.14) 



S>’*i ,0 <- r k ) C N <-r k )) T * v 

lC l (0, lim ji’°(0 ),..., lim <(.^ ,N (e)) T «9 I 

0 ^ k ^ 


and vs denotes the Kroneclcer product. The approximating operators 
Ajj : Z N Z N and their adjoints are given by 


( 3 * 15 ) " ( L (5 »^ N ) D + if> ) + fijj* (5 - lim_ t N (9)) 

0+O 

v-1 . _ 

+ E 6 N ’~ ( ' l 'N (-r k ) ” llm -V 6)) 

k =l UK 0 + N 

k 

and 

(3.16) A*(M n ) = ( lim_ * N (0) + aJ?, tt n (A T 5 - D + « )) 

0+0 

+ X { »’ + <A ^ 5 + e“! r - ' t ’N <8) - 

k 

+ S N >+ ' V r)) 


respectively. 


3.2 THE APPROXIMATE SOLUTION OF THE REQULATOR PROBLEMS 
The Continuous— Time Problem 


(3.17) 


b n p n 8 'Z 


L = 8|. 


N 


N 


and 
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(3.18) Q - p Q| -Q| 

N N Z N Z N 

and assume that problem (PI) with A, 8, Q and (n,<f>) replaced by Afj> Qjj 
and p^(n,<f>) satisfies assumptions analogous to (Al) and (Bl). (Under certain 
conditions, if the original system satisfies (Al) and (Bl) so too will the 
approximating systems if N is sufficiently large, see [14].) The 
approximating solutions to problem (PI) are then given in feedback form by 

(3.19) u*(t) = “R _1 B* P N P N z^(t), t > 0 

where Pjj is the unique nonnegative self-adjoint solution to the Riccati 
algebraic equation 


(3.20) P„ * P„ A„ + P„ 8„ R' 1 S* P„ 1 Q b - 0 


and z^ is given by 


(3.21) z*(t) =S N (t)(n ,<(>), t>0 


.N 


where {S (t) : t > 0} is the C q semigroup with infinitesimal generator 

a-br-'s'p^ . 


In practice, the approximating feedback gains are computed by solving the 
K n dimensional matrix Riccati algebraic equation 


(3.22) [A N ] T n N + n N [A N ] + n N [B N ]R -1 [ BN ] T n N + Q N = o 
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where brackets denote the operator's matrix representation with respect to the 
0 k i 

basis {e^ , e^ ,J } and the matrix is given by 


(3.23) 


n N 


Then, if we write 


(3.24) [P N ] = 


P 

N 

pl,0 

N 


p v ,N— 1 
N 


0 k 1 

where P N and P N ’ J , k = 1,2, ...,v, j = 0,1, 2, ...,N are n*n matrices, we have 


(3.25) u*(t) = p° x*(t) - /° r p^(9 )(x*) t (0 )d0 , t > 0 


with 


(3.26) - R-‘bJ P° , p‘(8) - I J r“bJ P*’> t^W), 

k=l j=0 


v N 


r 1 « T P k »j A k »j, 


-r < 0 < 0 


and (x N (t),(x N ) t ) = z N (t), t > 0 . 
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The Discrete-Time Problem 


For the discrete-time problem, we let 


(3.27) T n =T n (t) and = /q T N (t) 8 N dt 


where 8 N is given by (3.17) and {T N (t) : t > 0} is the C Q semigroup with 
infinitesimal generator The approximating solutions to problem (P2) are 

then given in feedback form by 


( 3 * 28 ) U N,k F N P N Z N,k’ k 


(3.29) 


— 1 * 

F - R B T P T , 
N N N N N 


(3.30) 


r n - R + Wn> 


P N is the unique, nonnegative, self-adjoint solution to the Riccati algebraic 
equation 


(3.3D P N - T* (P N - V n (R + V T N + % 


and z^ is given by 


Z N,k = (sN)k(n><|)) ’ k = 0,1,2,... 


(3.32) 
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wit h 


(3.33) 


s ”- T - B V»- 


The approximating feedback kernals can be computed from 

(3.34) [F„] - te N l' 1 [B 1) ) T r N [T N J , 
and 

(3.35) [R„] ■ R + [B H ] T r N [B N ] 
where 

(3.36) [T n ] = exp UA n ]t), [B n ] = /J, exp( [A N ] t) [B N ]dt 

and T n is the unique nonnetative symmetric solution to the dimensional 
matrix Riccati algebraic equation 


(3. 3 7 ) r N [t n ] (r N t n [b n ](r + [b n ] t n [b n ] [b n ] t n [t n ] + [q n ] 


If we set 


(3.38) 


IV^N 1 = C-S . ^’°,...,F V n ’ N ) 


0 k i 

where F^ and F^* , k = l,2,...,v, j =0,1,2,..*,N are nP<n matrices, we have 
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(3.39) u* >k - -f°x*(kr) -/° r f‘(e)(x*) lcI (e)d6, k - 0,1,2,. 


with 


(3.40) 





I I f£' J ^n’^ 95 ’ ~ r < 9 < 0 

k=l j-0 


and (x^kr), (x^^) = z^ k> k = 0,1,2,. 


3.3 CONVERGENCE 

The Continuous-Time Problem 


Elementary approximation properties of spline functions and the Trotter- 
Kato Theorem on the approximation of semigroups (stability together with 
consistency imply convergence, see [15], [20]) can be used to argue that 


(3.41) r N (t) + T(t) and T*(t) + T*(t), t > 0 


strongly on Z as N + 00 , uniformly in t for t in bounded sub-intervals, where 

(T N (t) : t > 0} and (T (t) : t > 0} are the Cq semigroups with infinitesimal 

generators and A respectively. Observing (numerically) that |P^| is 

bounded in N, it follows (see [7], Theorem 6.7) that P N converges weakly to P 

0 0 mxn 1 1 

as N 00 and consequently that P^ * p in R and p^ + p weakly in 

L 2^ _r 0’ as N + " . To obtain strong convergence of P N to P and strong 

Lo convergence of P* to P*, the only known result (see [7], Theorem 6.9) 
z n 

requires the existence of positive constants M and U), independent of N, for 


which 
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(3.42) |s N (t)| < t > 0, N > 1 

where { S N (t) : t > 0} is the Cg semigroup with infinitesimal generator 
— 1 * 

“ 8 n R B n P n p n . While all numerical results indicate that strong 

convergence of the approximating feedback kernals holds, analysis in [14] and 

numerical studies point to the fact that a uniform exponential bound of the 

form (3.42) can not be obtained for the Kappel-Salamon scheme. Indeed, both 

the open and closed-loop approximating systems yield a sequence of extraneous 

eigenvalues (i.e. ones which do not appear to be converging to an element of 

the spectrum of the original open or closed-loop herediatary system) 

00 _ 

{* N ) N= 1 for which Re X^ + 0 and Im \ + 00 (or - 00 ) as N + 00 . 

We note that the N-independent uniform exponential bound (3.42) which is 
sufficient for strong (in fact trace norm, see [7]) convergence of to P has 
been shown to hold for the AVE scheme in [22] and for the Legendre-tau method 
in [11]. 

The Discrete-Time Problem 

For the discrete-time problem (see [8], Theorem 3.12) |p^| bounded in N 
implies P N + P weakly, F N + F strongly, + f° in R m><n and f* + f 1 weakly in 
^(TjOjR ) as N + 00 . The existence of positive constants M and P which do 
not depend on N, with P < 1 and for which 

(3.43) |s£| < Mp k , k = 0,1,2,..., N > 1, 

where 
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is sufficient (see [8], Theorem 3.10) to conclude strong convergence of P N to 

P, uniform norm convergence of F N to F and strong convergence of 

to f^ as N + “ . Although numerical studies indicate that the stronger 

modes of convergence hold, the approximating open and closed-loop discrete- 

time systems constructed using the Kappel-Salamon scheme yield a sequence of 

00 — 

extraneous eigenvalues {p, T }_ T , with m.J + 1 as N 00 . 

N N=1 1 N' 

3.4 THE APPROXIMATE SOLUTION OF THE REGULATOR PROBLEMS WITH a -SHIFT 

One obvious approach for approximating the solutions to the LQR problems 

A 

with a-shift is to replace the operators A, 8 and Q in problem (PI) with the 

a 

operators Ajg, Bjj and Qjj or the operators T, B and Q in problem (P2) with Tjj, 
B^ and Qjj and then solve the finite dimensional shifted problems with states 
given either by 

(3.45) ^ z N (t) = ( A N + aI)z N (t) + 8 N u(t), t > 0 


or 


A J A A 

(3.46) z. T ... = — T z., , + — B u. , k = 0,1,2,. 

N, k+1 a N N, k a N k * * * 


However, if the Kappel-Salamon scheme outlined above is used, this approach 
will not work. Indeed, our numerical studies indicate that as a result of the 
extraneous eigenvalues introduced by the approximation scheme, for N 
and a sufficiently large the resulting finite dimensional systems are, at 
best, marginally stabilizable. The solutions to the matrix Riccati algebraic 
equations begin to deteriorate. Eventually the eigenvalue-eigenvector or 
Schur vector methods used to solve them fail completely. We 
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observe this independently of the stabilizability of the original underlying 
hereditary system. Since only the poles of the original hereditary system are 
to be shifted, this situation can be remedied by observing that the 
operator A+ oil is related to the intinitesimal generator for a hereditary 
system (semigroup) through a bounded similarity transformation. 

For Y a real number, define e L (Z,Z) by 

(3. 47) U Y (S,i|>) = (5,e Y >) , 

v0 

where the function e ^evaluated at 0 is e 4>(0), r < 6 < 0. Then 

(3.48) U" 1 ^) = (S,e" Y *i|0. 

The Continuous-Time Problem 

A /S A 

For the continuous-time problem, set w(t) = U Q z(t). Then w satisfies 

(3.49) w(t) = A Q w(t) + Bu(t), t > 0 

/V 

(3.50) w(0) = (h, e Q *<)) ) 

where for Y e R, A^: Dom(A) c z + Z is given by 

(3.51) A ^(^(0), tp) = U y (A + Yl) U~ 1 (i|>(0), <i>) = (Iy|>, Di|») 


with 
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v yr 

(3.52) LJ = (A +Yl)t(0) + l e *A <K-r . ) + /° e" Y8 A(e )f(6 )d0 

i=l 11 r 


Since U^ 1 is self-adjoint and U^Q U^ 1 = Q for all Y e R, the Kappel-Salamon 

A 

scheme can be applied to problem (PI) with A + al replaced 

A A 

with A a and z replaced with w . The extraneous eigenvalues will now remain 
stable and therefore cause no problems when the approximating feedback laws 
are computed. The approximating solutions to the continuous-time problem 
with a— shift are given by 


(3.53) 


u* (t) = -R 1 8* 


aN 


N ar N aN 


PM^xiCt) = -R 1 B* P 


'N 


aN p N U a z aN^’ 


t > 0 


where P aN is the solution to the Riccati algebraic equation (3.20) with A N 

. * . * * 
and replaced by A qN and A^ respectively and z qN is given by 

(3.54) z aN (t) = 5 a (t)(n > 0 

N 

where { S (t) : t > 0} is the Cg semigroup with infinitesimal generator 
A - 8R 1 B* P afJ P N . We have 

(3.55) u * N (t) = - p° N x* N (t) - !°_ r P < J N (0)(x* N ) t (0)d6 

” ^cxN x aN^ ~ ^ -r ^aN^ 9 ^ x aN\^ d9 » 1 > 0 

where p^ and p^ are obtained from in the same manner that p^ and p^ 
are obtained from P N (as in (3.2.6)) and (x* N (t), (x* N ) t ) = z* N (t), t > 0 . 
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The Discrete-Time Problem 

A A 

For the discrete-time problem, we set w. = U„z,. Then 

k 3 k 


(3.56) 


w , = T w. + B u, , k = 0,1,2,. 
k+1 a k a k > » » 


(3.57) 


w Q = (n,e «j>) 


where 


(3.58) 


I a-7 U B TD 6 1 - V T >- 


(Tp(t) : t > 0} the Cq semigroup whose infinitesimal generator is A„ , 


(3.59) 


B « - a 1 0 T e (t> B dt 


and 8 = -(lna)/x. The approximating solutions to the discrete-time problem 
with a-shift are given by 


(3.60) 


* * * * 
u aN,k = _F aN p N z aN,k = _F aN p N U 6 z aN,k’ k 


0 , 1 , 2 ,... 


where F qN is computed according to (3. 29 )— (3. 31 ) with F N , F^, B , T N and P N 
replaced by F qN , R aN , B aN> T aN and P aN respectively and z qN is given by 

(3.61) z aN,k = (S a )k(n><f,) ’ k " 0,1,2,... 


with 
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(3.62) S “ - T - BF aN P r 

Finally, we have 


(3 ' 63) “aVk ‘ -'aVaN^) ‘ V e > d9 



I W’ 1 * ~f-r f aN^ e ^ x aN^ kr^ 9 ^ d9 ’ 


k = 0,1,2,... 


where f^ N and f* N are obtained from F^ as were and f* from F N in (3.40) 
and ^ x aN^kr ^ = z aN,k ’ k = °> 1 » 2 >“* • 
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4. AN EXAMPLE AND NUMERICAL RESULTS 

We consider the second order linear harmonic oscillator with delayed 
damping given by 

(4.1) y(t) + y(t-l) + y(t) = u(t), t > 0 . 


We take the continuous-time performance index to be 


(4.2) J(u) = / y (t) 2 + y(t) 2 + u(t) 2 dt . 

0 

T 

Setting x(t) = (y(t), y(t)) , we rewrite (4.1) as a first order system; 


(4.3) x(t) = q) x(t) + (q _J)x(t-l) + (^)u(t), t > 0 . 


For this example we have n= 2, m= 1, r= 1, v = 1, A = 0, 


J). A,-(» _J). Q 0 -(J °) 


and R = 1. 

We computed the optimal feedback gains for the shifted and unshifted, 
continuous and discrete-time control problems on an IBM PC personal computer 
using the Kappel-Salamon approximation scheme and the a-shift technique 
outlined in the previous section. The matrix Riccati algebraic equations 
(3.22) and (3.37) were solved using either a standard eigenvalue/eigenvector 
(see [16]) or Schur vector (see [17], [19]) decomposition of the Hamiltonian 
matrix. For the discrete-time problem, matrix exponentials were computed 
using an eigenvalue/eigenvector decomposition. 
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A Scheme to Compute Eigenvalues of Linear Hereditary Systems 


In order to evaluate the performance of the method, we had to be able to 

compute approximations to the closed-loop eigenvalues of continuous-time and 

sampled hereditary systems. To do this we used a spline-based scheme 

developed in [10]. In the case of the continuous-time problem, the closed- 

loop system is a homogeneous hereditary system. Let A^ = A-BR * 8„ P „p 

N aN N 

denote the infinitesimal generator of the closed-loop semigroup 
iS (t) : t > 0} and let {Z^} denote a sequence of finite dimensional spline- 
based subspaces of Z which are contained in Dom(A)« Let : Z Z^ denote 
the orthogonal projection of Z onto Z M with respect to the inner product 


(4.4) «(S,t|0, (C,X)» Z = <A N (C,*),A N (c,x)> z . 


N 


An approximation to the spectrum of A is obtained by computing the 
eigenvalues of the matrix representation of the inverse of the operators 


(4.5) 


m, A -1 i 

<1 < A > I M 

Z 


Spectral convergence is argued in [10] using the theory of collectively 
compact families of operators (see [3]). 

The approach outlined above is used to obtain approximations T^ and B M to 
the discrete-time open-loop state transition operator T and input operator 

A 

B. The feedback gains F aN P N are projected (with respect to the standard Z 
inner product) onto Z M to obtain the operators F^ N . The eigenvalues of the 
operator T M - are taken to be an approximation to the closed-loop 


spectrum of the discrete-time system. 
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Numerical Findings 

The eigenvalues in the examples which follow were computed using the 
method we have described above with quintic splines and M taken large enough 
to declare a sufficient number of the eigenvalues converged. Typically, 
taking M = 30, which results in a 70 dimensional eigenvalue problem, sufficed 
to yield 21 converged eigenvalues. The resulting matrix eigenvalue problems 
were solved using IMSL routines EIGRF (the QR method for the standard 
eigenvalue problem) or EIGZF (the QZ method for the generalized problem). 

These computations were performed in double precision on the IBM 3081 at the 
University of Southern California. 

The eigenvalues of A N , the Nth Kappel-Salamon approximation to A » with 
real part greater than —3.5 (ordered by decreasing real part) are given in 
Tables 4.2 and 4.3 for various values of N. The first nine "true" continuous- 
time open-loop eigenvalues (eigenvalues of the operator A ) can be found in 
Table 4.1. Upon careful inspection of Tables 4.1, 4.2 and 4.3, one can easily 
discern the true eigenvalues of the hereditary system emerging and observe the 
behavior of the extraneous, artifactual eigenvalues which was described in the 
previous section as N increases. 

For the present example, we used the schemes described in Section 3 to 

*0 * i 

compute the continuous-time feedback gains, P aN and P aN for a = 0, 2.0 and 

3.0, and the discrete-time gains f .. and f ,, for a = 1.0, .98 and .975. 

C(N CXN 

As a is increased, larger values of N are necessary to ensure that the 

approximating optimal feedback laws have essentially converged. The results 

A 0 A 0 

presented below were computed with N = 10. The scalar gains p „ and f are 

aN aN 

given in Table 4.4 and 4.6 respectively. The kernals or functional gains 

^aN^2 an< * ^aN^2 ^ w ^ ere ( )j> J “ 1»2 denotes the j component) are plotted 

in Figures 4.5 and 4.7. Note that the initial conditions 
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(4.6) n = (0,0) T , (<|)) 1 arbitrary, (4> ) 2 = 0 


for the system (4.3) yield x(t) = 0, t > 0 and consequently that the optimal 
control isu(t) =0, t > 0 • This will also be true for the corresponding 
"ot-shif ted” systems. It therefore immediately follows from this observation 
and the basic structure of the finite dimensional approximating systems that 
the true and approximating, continuous and discrete-time optimal control laws 
do not feedback displacement history; that is 


(4.7) (^ N>1 - #>, - <*£,), ■ «;>! - 0 


for all N. 

The resulting closed-loop eigenvalues for the continuous-time systems are 
plotted in Figure 4.8 and are tabulated for the- discrete-time systems in Table 
4.9. In the discrete-time example, the length of the sampling interval t was 


taken to be .01. 
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N = 4 

N = 6 

N = 8 

1,2 

.0220 ± 1.60171 

.0219 ± 1.60191 

.0219 ± 1.60191 




-.5833 ± 12.7756i 




-.6503 ± 12.78191 

3 

-.7384 

-.7384 

-.7384 


-1.2679 ± 6.10631 

-.9824 ± 9.21361 



-1.5000 ± 5.80951 

-1.1564 ± 9.11741 



-3.4286 ± 2.96921 



4,5 


-2.0876 ± 7.04921 

-2.1251 ± 7.46371 



-2.8600 ± 6.31731 

-2.1392 + 9.99171 




-2.8084 ± 10.04311 


TABLE 4.2: EIGENVALUES OF A„ 

N 
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N = 10 

N = 

20 

N = 

30 

1,2 

.0219 ± 1.60191 

.0219 

± 

1.60201 

.0219 

± 

1.60201 


-.4513 ± 16.37311 

- .1227 

± 

34.09891 

- .0575 

± 

51.58971 


-.4681 ± 16.4023i 

- .1265 

± 

34.09771 

- .0576 

± 

51.58851 



- .4868 

± 

32.51681 

- .2258 

± 

50.48971 



- .5013 

± 

32.50501 

- .2264 

± 

50.49461 






- .4869 

± 

48.69591 






- .4938 

± 

48.70641 

3 

- .7384 

- .7384 



- .7384 




-1.3706 ± 13.71311 

-1.0176 

± 

30.08431 

- .8459 

± 

46.30801 


-1.5800 + 13.80841 

-1.0330 

± 

30.03231 

- .8707 

± 

46.31841 



-1.6310 

± 

26.70961 

-1.2170 

± 

43.39641 



-1.7094 

± 

26.83111 

-1.2651 

± 

43.37781 






-1.7362 

± 

40.00621 






-1.7657 

± 

39.90811 

4,5 

-2.0765 ± 7.54691 

-2.0483 

± 

7.58041 

-2.0471 

± 

7.58171 


-2.9685 ± 10.31021 

-2.4723 

+ 

23.11691 

-2.2485 

± 

36.28311 






-2.3628 

± 

36.44041 






-2.4687 

± 

32.36471 

6,7 


-2.5840 

± 

13.99561 

-2.6381 

± 

13.95671 



-2.7313 

± 

19.64551 

-2.7968 

± 

32.29341 



-2.8700 

+ 

23.20281 






-3.3004 

± 

19.08641 




8,9 





-2.9769 

± 

20.15021 






-3.3039 

± 

27.21711 






-3.3823 

± 

28.11491 


TABLE 4.3: EIGENVALUES OF A 

N 
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FIGURE 4.8: OPEN AND CLOSED-LOOP SPECTRUM - CONTINUOUS TIME 

EIGENVALUES OF A AND A - 8 R -1 8* P . 

10 alO 
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OPEN- 

■LOOP 

a = 

1.0 

a = 

.98 

a = 

.975 

MAG 

ARG 

MAG 

ARG 

MAG 

ARG 

MAG 

ARG 

.9926 

0 

.9919 

0 

.9693 

0 

.9630 

0 

1.0002 

± .0160 

.9938 

± .0170 

.9594 

± .0177 

.9484 

± .0211 

.9797 

± .0758 

.9796 

± .0759 

.9787 

+ .0758 

.9702 

± .0757 

.9739 

± .1395 

.9738 

± .1395 

.9738 

± .1395 

.9737 

± .1395 

.9703 

± .2027 

.9702 

± .2027 

.9703 

± .2027 

.9703 

± .2027 

.9677 

± .2658 

.9677 

± .2658 

.9677 

± .2658 

.9678 

± .2657 

.9656 

± .3288 

.9656 

± .3288 

.9656 

± .3288 

.9657 

± .3288 

.9639 

± .3918 

.9639 

± .3918 

.9639 

± .3918 

.9639 

± .3918 

.9625 

± .4547 

.9625 

± .4547 

.9625 

± .4538 

.9625 

± .4546 

.9612 

± .5176 

.9612 

± .5176 

.9613 

± .5176 

.9613 

± .5175 

.9599 

± .5806 

.9599 

± .5806 

.9600 

± .5806 

.9602 

± .5805 


table 4.9: OPEN AND CLOSED-LOOP SPECTRUM - DISCRETE-TIME; 

EIGENVALUES OF T AND T - BF 

alU 
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